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Abstract. In this paper we establish existence and nonexistence results concerning fully 
nontrivial minimal energy solutions of the nonlinear Schrodinger system 

-Au+ u= \u\ 2q ~ 2 u + b\u\ q ~ 2 u\v\ q inK'\ 

-Aw + uj 2 v = \v\ 2q ~ 2 v + b\u\ q \v\ q - 2 v in R". 

We consider the repulsive case b < and assume that the exponent q satisfies 1 < q < m 
case n > 3 and 1 < q < 00 in case n = 1 or n — 2. For space dimensions n > 2 and arbitrary 
b < we prove the existence of fully nontrivial nonnegative solutions which converge to a 
solution of some optimal partition problem as b — > —00. In case n = 1 we prove that minimal 
energy solutions exist provided the coupling parameter b has small absolute value whereas 
fully nontrivial solutions do not exist if 1 < q < 2 and b has large absolute value. 



1. Introduction 

In this paper we are interested in fully nontrivial minimal energy solutions of the system 

-Au+ u = \u\ 2q - 2 u + b\u\ q ~ 2 u\v\ q inR", 

(1) 

-Av + u 2 v = \v\ 2q - 2 v + b\u\ q \v\ q - 2 v mW n 

for parameter values u> > 1 and b < 0. We henceforth assume that the exponent q satisfies 
1 < 3 < ^2 when n > 3 and 1 < q < 00 when n = 1 or n = 2. For applications in 
physics the special case q = 2 and n e {1,2,3} is of particular importance. For example, in 
photonic crystals the system (Tj[|) is used to describe the approximate shape of so-called band 
gap solitons which are special nontrivial solitary wave solutions E(x,t) = e~ lKt (p(x) of the 
time-dependent nonlinear Schrodinger equation (or Gross-Pitaevski equation) 

id t E = -AE + V(x)E- \E\ 2 E in[0,oo)xM n . 



For a detailed exposition on that matter we refer to [7]. 

During the last ten years many authors contributed to a better unterstanding of such nonlin- 
ear Schrodinger systems and various interesting results concerning the existence of nontrivial 
solutions have been proved using Ljusternik-Schnirelman theory [15J, constrained minimiza- 
tion methods PQ, [B], [TT], [12], [II] or bifurcation theory [2]. In the case of a positive coupling 
parameter b many existence results for positive solutions of ([T]) have been proved by investi- 
gations of appropriate constrained minimization problems. For instance Maia, Montefusco, 
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Pellacci [TT] proved the existence of nonnegative ground states of ([TJ) which, by definition, 
are solutions of minimal energy among all nontrivial solutions. Here, the energy corresponds 
to the Euler functional I associated to ([1]) which is given by 

/(«,«) = \{M 2 + lit© - ^(IHIS + IMI2 + 26||u«||2) 

where || - || 2g , || • || 9 denote Lebesgue norms and || • ||, || • || w denote Sobolev space norms that we 
will define in ([§]). Moreover the authors gave sufficient conditions and necessary conditions 
for ground states to be positive in both components which basically require the coupling 
parameter b to be positive and sufficiently large. In the special case q = 2 additional sufficient 
conditions for the existence of positive ground states have been proved in [TJ, [6]. Furthermore, 
for q = 2 and small positive values of b Lin, Wei [9], [10] and Sirakov [12] proved the existence 
of positive solutions which have minimal energy among all fully nontrivial solutions. From a 
technical point of view the approaches followed in [TT] and [12] , [9] , [TO] differ in the following 
way. In [TTJ ground states are obtained by minimizing the Euler functional I over the entire 
Nehari manifold 

M b ={(«,«): u,veH\W), (u,v)^(0,0), \\uf + \\v\\l = \\u\\ll + \\v\\l q q + 2b\\uv\\lj 

whereas the positive solutions found in [12], [9], [10] are minimizers of I over the subset M. b 
of the Nehari manifold which is given by 

M b ={(u,v): u,v E H\R n ), u,v^0, \\uf = \\u\\% + b\\uv\\% \\v\\ 2 u = \\v\\ 2 2 q q + b\\uv\\ q }. 

When b is negative, however, the analysis of these constrained minimization problems does 
not produce any fully nontrivial solutions. Indeed, for b < the minimizers of I\j^ b are given 
by the semitrivial solutions (±w ,0) or (0, ±w ) (t ne latter being possible only for co = 1) 
where uq is the unique positive function satisfying — Au + uq = u^ 9 ' 1 in M. n , cf. [TT], [8]. 
Furthermore it is known that I\mi does not admit minimizers in case b < 0, cf. Theorem 1 
in [9]. Therefore the case of negative coupling parameters b < has to be treated differently. 
In [12] Sirakov considered the minimization problem 

(2) k,1 := inf / where M* b = {(u,v) G Ai b '■ u,v are radially symmetric} 

and he proved the existence of a minimizer of I\mi f° r parameter values q = 2 and n e {2, 3}, 
cf. Theorem 2 (i). Let us note that the indispensable condition n > 2 is missing in the 
statement of that theorem. 

The aim of this paper is to generalize Sirakov's result to all space dimensions and to the full 
range of superlinear and subcritical exponents. In Theorem [1] we first investigate the case 
n > 2. We show that minimizers (u b , v b ) of the functional I\m% exist and that, at least up to 
a subsequence, these minimizers of I\m* converge to a function (u, v) with uv = and 

(3) -Au + u = u 2q ~ 1 m{u^0}, -Av + u 2 v = v 2q ~ 1 in {v ^ 0} 
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I l|2 II 1 1 2qr ,, ,,2 ii u2q 

H = \\u\\ 2 q q , \\v\\ u = \\v\\ 2 q q 



that solves the optimal partition problem 

(4) «*oo:=inf{^(ll«l| a + IHia-^(ll«ll5+IHl5) = MeM*^} 
where the set M*-^ is defined by 

(5) M*^ = Uu,v) : u,v E H^(R n ), u,v ^ 0, uv = 0, 

Here, H}(R n ) denotes the space of radially symmetric functions lying in // 1 (IR n ). In partic- 
ular, we find that the supports of Ub, Vb separate as b — > — oo. In general bounded domains 
Q C M n these phenomena have been extensively studied in [3], jl], [5], [13] and our Theorem 
[1] can be considered as one kind of extension of their results. 

In case n — 1, however, the situation turns out to be different. Since the embedding 
Hj:(W n ) L 2? (IR n ) is not compact for n — 1 the existence of minimizers of I\m* cannot 
be proved the same way as in the case n > 2. Therefore we approximate the original problem 
by the corresponding problem on intervals Br = (-R, R) for large R > 0. In Theorem [2] 
we show that for negative coupling parameters b with small absolute value the corresponding 
minimizers converge to a minimizer of I\m* as R ~ * 00 • F° r negative b with large absolute 
value, however, we prove in Theorem [3] that solutions of (pQ) do not exist at least for exponents 
K q < 2. 

Let us present the main results of this paper. The first one deals with the case n > 2. 

Theorem 1. Let n > 2,u > 1. Then the following holds: 

(i) The value kI^, is attained at a nonnegative fully nontrivial solution of ([3]). 

(ii) For b < the value K* b is attained at a nonnegative fully nontrivial solution of ([T]). 

(Hi) As b — >■ — oo we have k\" — > and every sequence of minimizers of I\m* has a 

subsequence (ub,Vb) such that \b\ l l q u b Vb — > in L g (R") and (ub,Vb) — >■ (n, t>) where the 
latter function is a fully nontrivial solution of ([3]) with uv = 0. 

Since the proof of Theorem [1] makes extensive use of the fact that if *(IR n ) embeds compactly 
into L 2q (JBL n ) when n > 2 one has to resort to different methods when the space dimension is 
one. In Theorem [3] we show that there is a threshold value b*(u,q) G [— oo,0) such that K* b 
is attained whenever > b > b*(u,q) whereas k\" is not attained for b < b*(u,q). Moreover 
we find that b*(u,q) has the variational characterization 

f^h 1 -9|l7,J|- 2 9lU,JI? 9 fll7/.ll 2 -i- n, 2 \\n\\ 2 \* - \\ u \\l q - a 2q \\v\\ 2q 



(2 + a;^) 1 -«|| UQ ||-^|| Wo ||2g(ll«H 2 + « 2 



(6) b*(oj, q) = inf max — — " u " zgv " — II — " UUJ/ — — — 

where the infimum is taken over all u, v 6 H^(M.) with uv ^ 0. As above the function uq 
appearing in (E]) denotes the positive solution of — An + u = u 2q ~ x in M. n . Our first result 
dealing with the case n — 1 reads as follows. 

Theorem 2. Lei n — l,u > 1. T/ien £/ie following holds: 

q + l 

(i) We have k;*^ = (2 + a;?- 1 )/(%, 0) and k;*^ zs not attained at any element o/M^. 
(m] If b < b*(u,q) then kI = k!^ and k£ not attained at any element of 
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(iii) IfO > b > b*(u), q) then K* b < k*_ ^ and K* b is attained at a nonnegative fully nontrivial 
solution of (JT]). 

In view of part (iii) we may prove an explicit sufficient condition for the existence of a fully 
nontrivial solution of ([1]) by estimating the value b*(u,q) from above. To this end we use 
(■u, v) = (u , uq(u-)) as a test function in fl6]) which leads to the following result. 

Corollary 1. Let n = l,co > 1. Then for all b satisfying 

(7) > b > max ^ '- \ -j- 

the value k\" is attained at a nonnegative fully nontrivial solution of ([I]). In particular this is 
true in case 

(i) q = 2,b> 1 or (ii) u = 1, b > - 1. 

In order to find necessary conditions for the existence of a minimizer one has to estimate the 
value b*(u,q) from below. For exponents 1 < q < 2 we may combine Theorem [2] (iii) with 
the following nonexistence result to see that b*(u, q) must be larger than or equal to the right 
hand side in (jSJ). 

Theorem 3. Let n = 1,1 < q < 2 and assume 

. (oj 2 - (q - l)u)z 2 « - qz 2 - qu 3 z 2 ^ 2 - (uj 2 (q - 1) - u) 

(8) o < mm ■ 



z>o qz q+2 + (q -2)(lo 2 + u)z q + qu 3 zi- 2 

Then the equation ([T]) does not have any fully nontrivial solution. In particular this holds in 
case q = 2, b < or 1 < q < 2,u = 1, b < -1. 

Remark 1. (i) It is worth noticing that Theorem^ not only applies to solutions of min- 
imal energy but to all finite energy solutions. 

(ii) It would be desirable to know whether a similar nonexistence result is true for expo- 
nents larger than 2. 

(iii) From the strong minimum principle for nonnegative supers olutions of elliptic PDEs 
we know that the solutions (u, v) of (pQ) found in Theorem U\ and Theorem [H satisfy 
u > and v > when q > 2. For 1 < q < 2 we may apply the minimum principle to 
the function u+ v to conclude that u + v is positive. It seems to be unclear, however, 
if both u and v are positive functions in that case. 

Finally let us illustrate our main results with two qualitative graphs of the map b i— y tC h in 
the cases n > 2 and n = 1,1 < q < 2. The monotonicity of this function is referred to at the 
end of the first step in the proof of Theorem [TJ 
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2. Notations and conventions 

In the following we always assume n G N and 1 < q < whenever n > 3 and 1 < q < oo 
whenever n = 1 or n = 2 so that the Sobolev embedding H}(R n ) ->• L 2q (R n ) exists and 
is compact in case n > 2. A function (u, v) is called nontrivial if u ^ or v ^ and 
it is called fully nontrivial in case m / and v ^ 0. The same way (it, i>) is nonnegative 
whenever u > 0,v > and it is positive in case u > 0,v > 0. We always consider weak 
radially symmetric solutions of ([T]) and (E]) where it is clear that all solutions of ([T]) are twice 
continuously differentiable on M. n and smooth in the interior of each nodal domain. We use 
the symbols || ■ || r = || • ||l'(r«) to denote the standard Lebesgue norms for 1 < r < oo and 
we set v)\\ := a/IMI 2 + fHj^ for u, v G H^(R n ) where 

(9) IMI : = ( / \Vu\ 2 + u 2 dx) 1/2 , \\v\\ u :=([ \Vv\ 2 + u 2 v 2 dx) 1/2 . 
From the definition of / we get 

(10) I(u,v) = ^tt^(|M| 2 + \\v\\l) for all (u,v) eM b 

-'/ 

and in particular for all elements of A4b or Ail- The function u G H^(R n ) is defined as 
above and for notational convenience we put c := l(u ,0). We set v := u; 1 /^' -1 ^^-) so 
that Vq is the unique positive solution of —Av + u 2 v = v 2q ~ x in M. n . A short calculation shows 

2q-n(q~l) 

l{0,v )=u i- 1 cq. 

We will use the facts that the functions Uq, Vn are minimizers of the functionals J"f . Wp , 
respectively and that all minimizers of these functionals are translates of wc^o- Moreover, 
we use that («o, 0) is a minimizer of the functional I\x b when 6 < 0. 
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3. Proof of Theorem □ 

Throughout this section except for the first step we assume n > 2 according to the assump- 
tions of Theorem [U Its proof is given in four steps. First we prove variational characteriza- 
tions for the values kI^ which turn out to be more convenient than the original ones given 
by ([2]) and (jl]). In the second step we use these characterizations to prove that minimizers 
of the functionals I\mi an d AmL^ exist. In the third step we show that minimizers satisfy 
the corresponding Euler-Lagrange equation (JT]) or ([3]) so that the assertions (i) and (ii) of the 
theorem are proved. Finally we show part (iii) of the theorem. 



Step 1: A more convenient variational characterization for k^,k 

loo (n>l) 

For s,t > and u,v G H^{R n ) with u,v ^ one can check that (su,tv) G Ail is equivalent 
to (s,t) being a critical point of the function /3 UjV defined on M>o x IR>o and given by 

s 2 t s 2q t 2q bs q t q 
/3 UjV (s,t) := I(su,tv) = -^\\u\\ 2 + -\\v\\l - ~ 2^11^8 — IMI2- 

A necessary and sufficient condition for such a critical point to exist is given by 

(ii) Niy* + 6 IIHI2>°- 

Indeed, in this case the functional — /3 UtV is coercive so that (3 U ^ V has a global maximum. 
Moreover one can show that the Hessian of the function (s,t) h-> (3 UjV (s 1 ^ 2q , t 1 / 29 ) is positive 
definite on M >0 x M >0 so that the maximum is strict and no other critical point can exist. 
On the other hand a short calculation shows that (TTTj) is also a necessary condition for the 
existence of a critical point. From 

max B u Js, t) = max I(su, tv) 

s,t>0 ' s,t>0 

= max max I(su, sav) 

a>0 s>0 

= max max S \u\\ 2 + a 2 \\v\\ 2 J - + a 2q \\v\\% + 2ba q \\uv\\ q q ). 

a>0 s>0 Z Zq ii i 

9- 1 r nm M\ a + °?M\l) q ^^ 

IIlcLX. ■ 



2q \ *>o \\ u \\ll + a 2q \\v\\l q , + 2ba q \\uv\\ g q 
we obtain the following variational characterization for K* b : 



K* b = inf —J(u,v)^ :u,v£ if^(M n ), (u,v) satisfies (fTTj)} 



(12) 



2q 

where J(u, v) = max 



WW 2 + <* 2 \\v\\i) 



2\q 



a>0 + « 29 ll^ll2g + 2ba q \\uv\\ q q ' 
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Moreover if (u, v) satisfies (fTTj) and minimizes J then (su, tv) is a minimizer of I\m* provided 
(s, t) is the unique maximizer of j3 UjV . Similarly, one can show 

k*^ = inf \^-^j(u,v)^ :u,ve Hl(R n ),u,v ^0,uv = oj 

where J(«, v) = max L -^- = ( (ttttM 9-1 + (irir-) q ' 1 ) ■ 

Since the constraint uv = is more restrictive than (fTTT) we obtain the inequality 

(14) «:<«*oo (6<0). 

Moreover, from (1121) it follows that the map b h- >■ is nonincreasing. 

Sfep U: Existence of nonnegative minimizers 

We prove that both kI and k*^ are attained at nonnegative elements of Ail, AH^, re- 
spectively By the first step it suffices to show that the functionals J, J defined in ffT2"j) . (TT5|) 
admit fully nontrivial nonnegative minimizers. Since the reasonings for J and J are almost 
identical, we only give the proof for J. 

Let (uj,Vj) be a minimizing sequence for J satisfying (ITT]) . Since J(uj,Vj) = J(s\uj\,t\vj\) 
for all s,t > we may assume "U^u,- > as well as ||%||2g = ll^jlbg = 1- Then (uj,Vj) is 
bounded and there is a subsequence (uj,vj) that, due to the compactness of the embedding 
H^(R n ) — )■ L 2? (IR n ), converges weakly, almost everywhere and in L 2q (W. n ) x L 2q (M. n ) to some 
nonnegative function (u,v). This entails ||u||2g = \\ v \\2q = 1 as well as u,v > 0. Furthermore, 
(u, v) satisfies ( TTTj) because otherwise J(uj, Vj) would tend to infinity as j — > oo contradicting 
its property of a minimizing sequence. Hence, for all a > we have 

(NI 2 + « 2 I«) 9 <liminf . (Ik-ll 2 + « 2 ||%-|| 2 ) 9 



+ "^IMlS + 2&a«||iM;||| \\uj\\l 9 q + a^WvjWll + 2ba*\\u j v j \\% 



< lim inf max 



(INI 2 + /3 2 1MI 2 ) 9 

,->«, 3>0 || Ui ||2j + /^||^g + 2bP"\\ Uj V j \\ q q 

Using f[T2"j) we find j(it, u) < lim inf J(uj, Vj) so that (it, v) is a minimizer of J. 

Step 3: The solution property 

We prove the following two statements: 

(i) In case b < every minimizer of I\m* is a solution of flTJ). 

(ii) Every minimizer of I\m*_ is a solution of (151) . 

Let us show assertion (i) first. For u,v E H^(W a ) with -u, u 7^ set 

H^UjV) := ||w|| 2 - - and H 2 {u,v) := ||u|| 2 - ||^ || 2^ - 6||?x^|||. 
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so that (u, v) G Ail if and only if Hi(u, v) = H 2 (u, v) = 0. Now, if (u, v) G Ail is a minimizer 
of I\mi then H\(u,v) = H 2 (u,v) = implies 

H[(u, v)[u, 0] = 2|M| 2 - 2q\\u\\% - qb\\uv\\l = (2 - 2q)\\u\\ 2 + bq\\uvf q < 0, 
H' 2 (u,v)[0, v] = 2\\v\\l - 2q\\v\\ 2 2q - qb\\uv\\l = (2 - 2g)||v||= + bq\\uv\\* < 
so that Lagrange's multiplier rule shows that there are Li, L 2 G M such that 

(15) I'{u, v) + LiH[{u, v) + L 2 H 2 (u, v) = 0. 
It suffices to show L\ = L 2 = 0. 

Using (w, 0), (0, t>) as test functions in (TT5"j) we find (I'(u, v), (u, 0)) = Hi(u,v) = and 
f), (0, u)) = H^iu, v) — and thus 

= ((2 - 2g)|Mg + (2 - g)&|M|«)Li - <Z&|MI^2, 
= ((2 - 2^)||v|||| + (2 - g)6||w||«)L 2 - qb\\uv\\lL x . 

Assume (Li,L 2 ) ^ (0,0). Then ||wu||' > and the determinant of this system vanishes. We 
therefore get 

= ((2 - 2q) \\u\\l + (2 - q)b\\uv\\§ • ((2 - 2q) + (2 - q)b\\uv\\§ - {qb\\uv\\<$ 2 

= 4(1 - q) {{b\\uv\\lf - q ^b\\uv\\l{\\u\\l% + \\v\\H) -(q- l)\\u\\ 2 2 " q |Mg) . 
Solving for &||m>||3 < gives 

46|H|; = (q- 2)(\\u\\H + || V |g) - V / ( ? -2)2(||n||g+||t;||^2 + 16(g _ 1) || n ||g|| v ||g_ 

Let now A, B > be given by \\u\\^ q = A ■ \b\ \\uv\\ q , \\v\\%, = B ■ \b\ ||w||„. Then 

(16) -4=(q~2)(A + B)-y/(q- 2)\A + Bf + 16(g - l)AB. 
where A, B are larger than 1 because of 

h\\l q q - \b\\\uv\\i = \\uf > o, - i&iihi; = \\v\\l > o. 

Solving ffT6l) for B we obtain 

B _ 2 + (q-2)A 

2(q-l)A-(q-2) 

so that A > 1 implies B < 1, a contradiction. Hence, the assumption was false, i.e. 
I'(u,v) = 0. 

Now consider (ii). Let (u,v) G -Ml^ be a minimizer of the functional I\m*_ ■ Due to 
the one-dimensional Sobolev embedding we may choose u,v to be a continuous function 
on R n \ {0} so that the sets {u ^ 0},{v ^ 0} are open. According to the first step we 
have J(u, v) < J(u + (p, v + ip) for all test functions (p, ip with supp(</?) C supp(w) and 
supp(^) C supp(f). In view of the second formula for J in ( fl~3|) we find that (u, v) solves ([3]). 
□ 
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Remark 2. The above reasoning shows that all critical points and not only minimizers of 
I\m% or Am*^ satisfy the corresponding Euler-Lagrange equation. 

Step 4- Convergence to a fully nontrivial solution of ([3]) as b — > —oo 

Let (bj) be a sequence such that bj — >■ — oo and let (uj,Vj) G M\. be a sequence of nonnegative 
fully nontrivial solutions of (OQ) given by the second step, in particular I(uj,Vj) = K* h .. Then 
(uj, Vj) is bounded and there is a subsequence (uj, Vj) that, due to the compactness of the em- 
bedding H^(M. n ) — > L 2q (M. n ) } converges weakly, almost everywhere and in L 2q (R n ) x L 2q (W. n ) 
to some nonnegative function (u,v). From Sobolev's inequality we get 

INI 2 = \\uj\\l q q + bjWujVjWl < \\uj\\l q q < C\\uj\\ 2q , 
= WvjWll + bjWujVjWl < \\vjWH < CWvjfj 

and thus ||%||2g> H^jlhg ^ c > where c, C are positive numbers which do not depend on j. 
It follows ||m||2 9 , ll^lhg > c and thus u, v ^ 0. In addition we find 

(17) N 2 < IN||, \\v\\l <\\v\\%. 

Since the sequence (uj,Vj) is bounded we get uv = from 

\\uv\\ q = lim ||ujW,-||o = lim (11^ || 1? — || 2 )|^ 3 | 1 < liminf C ■ = 0. 

Furthermore, from ffT^j) we obtain k% < so that ffTOl) implies 

^(IMI 2 + \Ml) < ^liminf(|| % || 2 + {fat) 
zq Zq j-!>oo 

= lim inf k\ 

j— >oo 3 

< lim sup K* b 

J-KX3 

< K -oo 

q — \f, ||w|| n4ti JI^IU \-??r 

<^i(NI 2 + IND 

where we used ({TBI and (TTT|) in the last two inequalities. Hence, equality occurs in each line 
and thus ||m|| 2 = ||"u||2g, H^H 2 = ll^ll^ as wen as K t ~~ ^ K *oo' ( u j> v j) ~^ (u,v) as 6 — > — oo. 
This entails (w, v) G -Ml^ and I(u,v) = k;*^, so that is a minimizer of I|.Mi an d 

thus a fully nontrivial nonnegative solution of ([3]). Finally, the assertion follows from 

limsup |6j|||WjUj||^ = limsup 1 1 1% 1 1 2„ — \\ u j\\ 2 = INI^ — ||w|| 2 = 0. 

j— >oo j—^oo 
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4. Proof of Theorem [2] and Corollary [JJ 

Proof of (i) 

q+l 

First we show > (2 + ui-^cq and that no element of M*-^ attains this value. Let 
(u, v) G -Ml^ and in particular u(0)v(0) = 0. We first assume it(0) = 0. Then the nontrivial 
functions Ui :— u- l(_oo,o) 5 u r := u- l(o )0 o) he in they have disjoint support and satisfy 

u r (r) = m(—r) due to u G In particular from ||w|| 2 = \\u\\^ we infer 

II II 2 — II II 2 - ^11 II 2 - II ll 2 "? — II \\ 2 i — II ll 2< ? 

\\ U l\\ ~ \\ U r\\ — 2" U " ~ 2 H M H 2| 3 ~~ ll^'lbg ~~ II^Mhg- 

This implies (u r , 0), (ui, 0), (0, u) G A& and using f lTUj) as well as -u-u = we obtain 

J(u, v) = I{u h 0) + I{u r , 0) + J(0, u) 
q-1 



(iKii 2 +ikir+iHiy 

O—l // \\ui\\ x^2_ ,11 U r II x _22_ , IML . _2a\ 

iLh + (nbli ) + in )• 

9n Br 5n \W\\o„ / 



2<? V ||w?||2g IKIU IMU' 

Since the functions u ,v minimize the quotiens jjjj^-, ]j^r we S e ^ 
/( K ,„)>^i.(2.(^f)A + ( ^)A 

2 ? V ll M o||2 g IMU 

= ^i-(2|K||» + |W£) 

= 2/(%,0) + 7(0,« ) 

g+1 . 

= (2 + a;?- 1 )^). 
Analogously the assumption v(0) = leads to 

q+l q+l 

I(u, v) > (1 + 2cj«-i )c > (2 + o;«-i )c . 

q+l 

We therefore get k*^ > (2 + w^ 1 )^. Moreover we find that is not attained at any 
element of M*-^ because in case u(0) = this would lead to the conclusion that u r ,Ui are 
translates of uq which is impossible because of supp(w r ) n supp(-u^) = 0. A similar reasoning 

q+l 

shows that no element (u, v) of M.*.^ with v(0) = can have energy (2 + cui- 1 )Cq. 

Now let us prove the opposite inequality. To this end let Xk '■= xi.^ 1 ') denote a suitable 
radially symmetric cut-off function with x = 1 i n [ — 1- 1] an d X = outside of (—2, 2) then 
the sequence 

(u k ,v k ) := ({uoXk)(2k + •) + (u x k )(-2k + -),VoXkj 

lies in M*_ ^ and 

lim I(u k ,v k ) = lim (2I(u Xk,0) + I{0,v Xk)) = 2I(u , 0) + 1(0, v ) = (2 + )c 

fc— »oo fe— >-oo 
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q+l 

which proves < (2 + u)*- 1 )oq. Hence, we obtain 

k* = (2+u^W 



Proof of (ii) 

First we prove that b < b*(u,q) implies kI = wl^ and that > b > b*(u, q) implies kI < ftl^. 
From (i) and the variational characterization for given by ( I12p we get K* b < /cl^ if and 
only if there are functions u,v G H^(M. n ) with u, v ^ and UmII^II^IIL > l&III^HIg that satisfy 

(\\u\\ 2 + a 2 \\v\\ 2 ) q ( 2q . . s+i „ , ||u || 29 

max .. — v " H . „ ." Ilcj; — - < (— ^ ■ (2 + w^)c J = (2 + w«=i)«- J 11 11 



a>0 ||w|l2? + MINI'S + 2&aff||tM>||! Vg-1 / ^ IMI22J' 

In this case (i) and fTT3]) implies uv ^ and thus b > b*(u,q) after some rearrangements of 
the above inequality. A short argument shows that > b > b*(u, q) implies K* b < fcl^. 

Let b < b*(u,q) and assume that nl = k^L^ is attained at some function (u,v) satisfying 
the condition fTTTj) . Then uv ^ since k*^ is not attained, see (i). Choose £ > such that 
b + e < b*(u,q) so that k£ +£ = kI^. Then (u, u) satisfies f JTT|) for b + e instead of b and we 
get 



* 9-1/ (lhll 2 + a 2 lk 

k. = max 



2 + „2||„||2^ N _A_ 



2? V «>o ||«||^ + a 2 «||t;||^5 + 26a9||tw;||| 



1 

9-1 



2q \ ^>o \\ u \\l q q + a^\\v\\ 2 2 q g + 2(b + e)a^\\uv\\ q q 

> < + e 
= K -oo 

which contradicts kI = rel^. Hence, kI is not attained for b < b*(oo,q). 
Proof of ( in ) 

In order to prove (iii) we suppose > b > b*(u, q). From the first statement in the proof of 
(ii) it follows that this implies 

(18) kI< k* oo = (2 + w^)c . 

For these values of b let us investigate the behaviour of a special minimizing sequence for 
the functional I\m*- We consider the corresponding problem on balls B R = (—R,R) where 
R will be sent to infinity. We set Hl r (B R ) := {u G Hq(B r ) : u is radially symmetric}. All 
solutions (u,v) G Hl r (B R ) x Hl r (B R ) of the boundary value problem 

-u"+ u = \u\ 2q ~ 2 u + b\u\ q - 2 u\v\ q mB R , 

(19) -v" + u 2 v = \v\ 2g - 2 v + b\v\ q ~ 2 v\u\ q in B R , 

u(-R) = u(R) = 0, v(-R) = v(R) = 
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satisfy 

(20) I \u'\ 2 + u 2 dx = j \u\ 2q + b\u\ q \v\ q dx, 

J B R J B R 

(21) / \v'\ 2 + co 2 v 2 dx = [ \v\ 2q + b\u\ q \v\ q dx. 



B, 



Following the approach of the last section we define 

M* b (R) := {(u,v) G Hl r (B R ) x Hl r (B R ) : u,v + 0, {u,v) satisfies (EUJ) , (J2U } . 
As before one can show that inf I\m^(R) admits a variational characterization given by 

(22) K* b (R) := Jn^I = inf ^^^J(u,v)^ :u,ve Hq^(Br), (u,v) satisfies ([II])}. 

Using the compactness of the embedding HI t (Br) — > L 2q (B R ) for all R > we obtain the 
following result: 

Proposition 1. Let n = 1. For all b < i/ie m/^e k>1(R) is attained at a fully nontrivial 
nonnegative solution (ur,vr) G Hq^Br) x HI t (Br) of (TT9l . Moreover, as R — > oo we /iai>e 

Proof. The existence of a fully nontrivial nonnegative minimizer of Jl^*^) can be shown as 
in the second step in the proof of Theorem [U From the inclusion M. b (R) C Ai* b it follows 

(23) K* b (R) > 4. 

In order to show i^l(R) — > k\ as R — > oo we choose a cut-off function x with x( x ) — 1 f° r 
|x| < | and x(x) = fr |x| > 1, set Xr( x ) '■= x(R~ lx )- Then for all u,v G -ff^(lR) we have 
u XRi v Xr (Br). Moreover, if in addition (w,f) satisfies (TTT1) so does (uxr,vxr) for 

sufficiently large i? > and we get from (T2"2"|) the inequality 

limsup^( J R) < ^— -^limsup J (uxr, vxr) 1 ^ = ^——J(u, v)^ . 

r^oo r^oo 

Since this holds for all u,u6 Hr(^) satisfying (TTTT) we obtain from (Tl2|) the estimate 

(24) limsup^(^) < ^. 

The inequalities ([23]) and ([24]) show /^(i?) -> k£ as ->■ 00. □ 

Let now (uk,Vk) : = (uR k ,VR k ) be the sequence of solutions on (—R k ,R k ) given by Proposi- 
tion [U where (i?^) is a fixed positive sequence going off to infinity as k — > 00. Then (u k ,v k ) 
lies in Ml(R k ) c A4£ and we have I(u k ,v k ) = ^t(Rk) — > as A; — )• 00 by Proposition [TJ 
Since (u k ,v k ) solves f lT$]) on (—R k ,R k ) there is a real number a k such that 

(25) -u' k 2 - v' k 2 + u 2 k + u 2 v 2 k - -(u q + v 2 k q + 2bu q k v q k ) = a k in (-R k ,R k ) 

and u k (R k ) = v k (R k ) = implies a k < 0, see Proposition [2] for the proof of a related result. 
The sequence (u k , v k ) is bounded in H^(R) x H^(R) and we may choose a subsequence again 
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denoted by (u k ,v k ) that converges weakly to some (u,v) G H^(K) x H^(R). Then R k — >■ oo 
implies that (u,v) is a nonnegative solution of ([T]) with I(u,v) < K* b . It remains to show 
u, v 7^ 0. 

We assume u = 0. Since tifc,^ are radially symmetric we have u' k (0) = v' k (0) = 0. From 
b < and ([25]) we get the inequality 

> a k > u k (0) 2 (q - u k (0) 2 i- 2 ) + v k (0) 2 (qu 2 - v k (0) 2 ^ 2 ). 

From u k (0) — > u(0) = it follows v k (0) > (qui 2 ) 2< ?- 2 for almost all k and hence v(0) > 0. It 
follows that (u,v) = (0,v) is a solution of ([I]) satisfying f(0) > as well as v > 0. Kwong's 
uniqueness result [8] gives v = v and we obtain 

(26) (u k ,v k ) - (0,0, (« fc) ^)^(0,« )inCf oc (R). 



Let now G [0, R k ) be given by 



max u k = u k (x k ) = u k (-x k ) > 0. 
—Rk,Rk] 



From the differential equation (119]) and b < we infer 

n < U k( X k) _ U k (x k ) 2q " 1 + bu k (x k ) q ~ l V k (x k ) q - U k (x k ) 2(? _ 2 _ 

Uji /X , , U k yX k j 1 

and thus 

(27) u k (x k ) = u k (-x k ) > 1. 

From (126]) .( 127]) we get — » +oo. Let now (u k , v k ), (u k , v k ) be given by 

(u£ ,v£) := (u k (- + x k ),v k (- + x k )), (u k ,v k ) := (u k (- - x k ),v k (- - x k )). 

These sequences are bounded in i/ 1 (M) x i/ 1 (M) and there are subsequences again denoted 
by (u k , v k ), (u k ,v^) that converge weakly and locally uniformly to nonnegative functions 
(u + ,v + ), (u~ ,v~), respectively The inequality ( 127]) implies u + (0),u~(0) > 0. Since the 
functions (u + ,v + ), (u~,v~) are nontrivial solutions of ([I]) on (— oo,a), (— a, oo), respectively 
where a := lim fc _ s . OC) (i? fc — x k ) we obtain (u ± , v ± ) G A/j and ( TTD]) gives 

(28) ^(H^ll 2 + llt^H*) = C ± ) > min J = I( Uo , 0) = c . 

Now let x denote a cut-off-function satisfying xi x ) = 1 f° r \ x \ — 1 an d yX^) = f° r M > 2, 
set x_r(x) := x(i? _1 s). Choosing k (R) sufficiently large we obtain x k > 2R for all k > k (R). 
In particular for all k > k (R) the sets supp(y_r), supp(xi?.(- — x k )), supp(x/?( - + x k )) are 
pairwise disjoint and we get 

\\(uk,v k )\\ 2 

> \\(u k XR,v k XR)\\ 2 + \\(u k xn(- ~ Xk),v k xn(- - x k ))\\ 2 + + x k ), v k Xn(- + x k))\\ 2 

= \\(u k XR,v k x R )\\ 2 + \\(u+xr,Hxr)\\ 2 + UKXr^^XrW- 



|2 
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From (u k ,v k ) (0, v ), v£ ) (-u + ,i) + ) and (u£,v£) we infer 

liminf ||K,^)|| 2 > ||(0,«oXfl)ir+ ll(« + XK^ + Xi?)ir+ ||(w~Xh,«~Xb) 

= IKXii|| 2 + \\(u + Xr,v + Xr)\\ 2 + || ^~Xii)|| 2 - 
Since this inequality holds for all R > we obtain 

liminf \\(u k ,v k )\\ 2 > \\v \\l + ||(^+)|| 2 + ||(^,ni| 2 

re— >-oo 

and from the estimate (1251) and (|T0|) we get 

k£ = lim AcJ(i2 fc ) 

re— >oo 

= ^7T-, lim IIK^fc)f 
Zq k— ¥oo 

> q ^{}Ml + \\{u\v + )\\ 2 +\\{u-^ 
> (2 + w^)c 

which contradicts (JT5J. Hence, « / 0. Analogously the assumption v = leads to the 
inequality 

«J > (1 + 2u^)c > (2 + w^)c , 
which again gives a contradiction. It follows u, v ^ and the proof is finished. □ 

Proof of Corollary [J\ 

Assume that b is larger than the right hand side in (J7]). According to Theorem [2] (iii) it 
suffices to show that this implies b > b*(u,q). To this end we estimate b*(cu,q) from above 
using the test function (u,v) := (uo,u (u-)) in ([6]). We obtain 



(2 + cu^-i^ll-^^II^KII 2 + a 2 \\u (u-)\\ 2 J q - Kg - o^lMwOHS 



b*(u>, q) < max 



q>o 2a q \\u u (u- 



\1 



2+1. 



(2 + u;^!) 1 -^! + a 2 ^) 9 - 1 - a^uj- 1 \\u \\l q Q 

max ■ 



'o>o' 2a« ||tt Uo(w-)||g' 

The numerator function is bounded from above by its negative maximum 2 1 ~ q — 1 which is 
attained at a = 2~ 1 I 2 oj^~ 1 . In particular, the right hand side is negative for all a > so that 
the estimate ||M Mo(w - )llq — ll^ollljll^o^")!!!} = w_1 ^ 2 |l u o|l2g leads to 

N (2 + u^Y- q (l + a 2 u) q -1- a 2q uj- 1 
b*(uj, q) < max - - -jz 

where the right hand side is smaller than b by the assumption of Corollary [TJ As indicated 
above the result now follows from Theorem [2] (iii). 



MINIMAL ENERGY SOLUTIONS FOR REPULSIVE NONLINEAR SCHRODINGER SYSTEMS 15 

Finally, in the special cases g = 2 or 1 < g < 2, u = 1 we may determine the value of the 
right hand side in (j7|) explicitly. In case q = 2 the maximum is attained at a = )^ ^/ 4 
and we get 

b*(u,2) < 1 

w 3 / 2 + v/2(l + u; 3 ) 

In case l<g<2,o; = l the maximum is attained at a = 1 and we obtain the value 



5. Proof of Theorem [3] 
In the proof of Theorem [3] we will need the following elementary result. 

Proposition 2. Let n — l,u > 1. T/ien every solution (u,v) G i? 1 (M.) x o/ (DQ) 

satisfies 

(29) -n ,2 -v ,2 + n 2 + a;V- -(|m| 2? + |v| 29 + 26|«Hi;H =0 m R. 

Proof. For a solution (it, u) of ([I]) the derivative of the left hand side in (1291) exists and equals 
zero. Hence there is some a G K such that 

-z/ 2 - v' 2 + u 2 + u 2 v 2 - -(\u\ 2q + \v\ 2q + 2b\u\ q \v\ q ) =a in R. 

Q 

If a were not equal to zero then there would exist 5 > such that u' 2 + v' 2 + u 2 + a; 2 f 2 > 5 
in R which contradicts u.v G i/ 1 (R). □ 



Proof of Theorem 

Let 6 G R satisfy the inequality dHJ). We assume that there is a fully nontrivial solution 
(u, v) G H 1 (R) x if^R) of (EQ). Since the functions (-u, v), (u, -v), (-u, -v) solve (HJ, too, 
we may assume that a maximal open interval ic{i6M: u(x) > 0, v(x) > 0} is non-empty. 
We will prove later that the assumptions of the theorem imply that every critical point of 
u^v in A is strict local minimizer. Once this is shown a contradiction can be achieved in the 
following way. 

In case u w v does not have any critical point in A the function u^v is monotone on A so 
that A is unbounded and (u^v)^) does not converge to as |x| — > oo. This contradicts 
u,v G if 1 (R). If, however, a critical point Xq G A exists, then x is a strict local minimizer 
and therefore it must be the only critical point because any other critical point would have 
to be a strict local minimizer, too. It follows that u^v is increasing on (xq,oo) fl A and 
decreasing on (— oo,xq) fl A so that {u u v)(x) > {u w v)(xq) > for all x G A. Hence, A = R 
from the maximality of A and thus (u ul v)(x) > (u uj v)(xq) > for all x G R which contradicts 
u,v G HHR). 



16 RAINER MANDEL 

Now we show that every critical point of u u v in A is a strict local minimizer. Clearly, for 
x G A such that (u 0J v)'(x) = we have 

(30) cou'(x)v(x) = —u(x)v'(x) 
and a short calculation gives 

(31) u\x)v\x) = -uu(x)v(x) ■ ^M— 

Using fl30|) we obtain at the point x 

{u"v) n = u{u - l)u w - 2 u' 2 v + wuV _1 v + 2uv!u"- x v' + u"v" 

= it" -1 (u— ■ (u - l)u'v + uvl'v + 2uu'v' + uv"^j 
= u^ 1 f - (u - l)u'v' + uu"v + +2awV + 

= U^" 1 ( (w + l)ttV + + W' 



From ( 1HT|) and the partial differential equation satisfied by (it, v) we get 



7/ /2 _j_ 12 

{u"v)" = u"- x [ -u{uj+1)uv " 



V? + U 2 V 2 

+ uuv(l - u 2q - 2 - bu q ~ 2 v q ) + uv{u 2 - v 2q - 2 - bv q - 2 u q ) 

Proposition [5] gives 

t u Ml w ( l i\ fi u 2q + v 2q + 2bu q v q 
(u w v)" = u UJ v( - u(u -hi) - ( 1 — 



q(u 2 + ui 2 v 2 

+ u- cou 2q - 2 - buu q ~ 2 v q + co 2 - v 2q - 2 - bv q - 2 u ( 



u{u + l){u 2q + v 2q + 2bu q v q ) - q{u 2 + u 2 v 2 ) 



q(u 2 + oo 2 v 2 ) 

(uu 2q - 2 + buu q ~ 2 v q + v 2q ~ 2 + bv q - 2 u q ) 
( _ bqu q+2 v q - 2 + (tu 2 -(q- l)u)u 2q - qv 2 ^ 2 



q(u 2 + oo 2 v 2 ) 

+ 5(2 - q){u 2 + u)u q v q - qco 3 u 2q - 2 v 2 

- {u 2 (q - 1) - u)v 2q - bqu 3 u q - 2 v q+2 



( - bqz q+2 + (oo 2 -(q- l)u)z 2q - qz 2 



q{u 2 + u 2 v 2 ) 

+ 6(2 - q){u 2 + w)^ - qu 3 z 2q - 2 

- {u 2 {q - 1) - u) - bqu 3 z q - 2 ' 
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where z := From assumption (jHj) and u(x),v(x), z > we obtain (u u v)"(x) > which 
proves the claim. We finish the proof of Theorem [3] considering the special cases q — 2 and 
1 < q < 2,uj — 1. 

In case q = 2 the minimum in is attained aX z = y/u and we obtain that fully nontrivial 
solutions do not exist for parameter values b < — . In case l<g<2,oj = lwe find that 
the following inequality holds for b < — 1 and all z > 

(-6) • (qz q+2 - 2(2 - q)z q + qz q ~ 2 ) + (2 - q)z 2q - qz 2 - qz 2q ~ 2 - {q - 2) 

> 1 ■ (g^+ 2 - 2(2 - q)z q + qz q - 2 ) + (2 - g)^ 9 - g^ 2 - qz 2q - 2 - (q - 2) 
= (2 - g)(^ - l) 2 + g(^ 2 - ^- 2 )(^ - 1) 

> 

with equality if and only if b = — 1 and z = 1. Rearranging terms we see that the minimum 
in (jSJ) is 1 and it is attained at z — 1. We obtain the nonexistence result for 6 < — 1. □ 

Remark 3. In the above reasoning we did not use the assumption 1 < q < 2 explicitly. 
Nevertheless we had to exclude the case q > 2 case because the minimum in OH]) does not 
exist. Indeed, sending z to and using u > 1 > we /ind i/iai £/ie infimum is — oo. 

References 

[1] A. Ambrosetti and E. Colorado. Bound and ground states of coupled nonlinear Schrodinger equations. 

C. R. Math. Acad. Sci. Pans, 342(7) :453-458, 2006. 
[2] T. Bartsch, N. Dancer, and Z.-Q. Wang. A Liouville theorem, a-priori bounds, and bifurcating branches 

of positive solutions for a nonlinear elliptic system. Calc. Var. Partial Differential Equations, 37(3- 

4):345-361, 2010. 

[3] M. Conti and V. Felli. Minimal coexistence configurations for multispecies systems. Nonlinear Anal., 
71(7-8):3163-3175, 2009. 

[4] M. Conti and V. Felli. Global minimizers of coexistence for competing species. J. Lond. Math. Soc. (2), 
83(3):606-618, 2011. 

[5] M. Conti, S. Terracini, and G. Verzini. A variational problem for the spatial segregation of reaction- 
diffusion systems. Indiana Univ. Math. J., 54(3):779-815, 2005. 

[6] D. G. de Figueiredo and O. Lopes. Solitary waves for some nonlinear Schrodinger systems. Ann. Inst. 
H. Poincare Anal. Non Lineaire, 25(1):149-161, 2008. 

[7] T. Dohnal and H. Uecker. Coupled mode equations and gap solitons for the 2D Gross-Pitaevskii equation 
with a non-separable periodic potential. Physica D Nonlinear Phenomena, 238:860-879, 2009. 

[8] M. K. Kwong. Uniqueness of positive solutions of Am — u + u p = in R". Arch. Rational Mech. Anal, 
105(3) :243-266, 1989. 

[9] T.-C. Lin and J. Wei. Ground state of coupled nonlinear Schrodinger equations in R", n < 3. Comm. 
Math. Phys., 255(3):629-653, 2005. 
[10] T.-C. Lin and J. Wei. Erratum: "Ground state of A^ coupled nonlinear Schrodinger equations in R™, 
n < 3" [Comm. Math. Phys. 255 (2005), no. 3, 629-653; mr2135447]. Comm. Math. Phys., 277(2):573- 
576, 2008. 

[11] L. A. Maia, E. Montefusco, and B. Pellacci. Positive solutions for a weakly coupled nonlinear Schrodinger 

system. J. Differential Equations, 229(2) :743-767, 2006. 
[12] B. Sirakov. Least energy solitary waves for a system of nonlinear Schrodinger equations in R". Comm. 

Math. Phys., 271(1): 199-221, 2007. 



18 



RAINER MANDEL 



[13] H. Tavares and S. Terracini. Sign-changing solutions of competition-diffusion elliptic systems and optimal 
partition problems. Ann. Inst. H. Poincare Anal. Non Lineaire, 29(2):279-300, 2012. 

[14] J. Wei and T. Weth. Nonradial symmetric bound states for a system of coupled Schrodinger equations. 
Atti Accad. Naz. Lincei CI. Sci. Fis. Mat. Natur. Rend. Lincei (9) Mat. AppL, 18(3):279-293, 2007. 

[15] J. Wei and T. Weth. Radial solutions and phase separation in a system of two coupled Schrodinger 
equations. Arch. Ration. Mech. Anal, 190(1):83-106, 2008. 

R. Mandel 

Department of Mathematics, Karlsruhe Institute of Technology (KIT) 
D-76128 Karlsruhe, Germany 
E-mail address: Rainer.Mandel@kit.edu 



